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digital  parallax  extraction  systems.  However,  areas  such  as 
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attain  its  potential  in  an  operational  environment. 
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SECTION  I 


INTRODUCTION 


The  objectives  of  the  activities  reported  in  this  Final  Report  were 
to  conduct  experimental  tests  and  to  evaluate  a large  aperture  frequency 
plane  correlator  which  derives  terrain  elevation  data  from  stereo  aerial 
photography.  Under  Contract  Number  F30602-73- C-03 12  with  Rome  Air 
Development  Center,  the  Electronic  Systems  Division  of  Harris  Corporation 
has  performed  a series  of  coherent  optical  correlation  experiments  with  a 
breadboard  system  supplied  by  RADC. 

During  the  course  of  these  experiments,  the  equipment  supplied  by 
RADC  was  evaluated  and  modified  to  provide  a higher  level  of  system  aut 
mation  and  improved  system  performance. 

Experimental  results  from  this  effort  demonstrate  that  parallax 
data  obtained  with  the  coherent  optical  correlator  compares  favorably  with 
results  from  an  operational  electronic  correlation  system,  the  AS-11B. 
Quantitative  comparisons  have  yielded  an  r.  m.  s.  difference  of  less  than  30p 
along  a profile,  which  is  remarkably  good  in  view  of  the  limited  sophistication 
of  the  present  optical  processing  system.  This  report  describes  the  experi- 
mental effort  and  results  obtained  in  this  study,  and  presents  conclusions  and 

recommendations. 

Some  background  of  automatic  stereo  compilation  and  the  potential 
advantages  of  coherent  optical  techniques  are  covered  in  Section  ! . Experi- 
mental results  and  their  significance  are  summarized  in  Section  2,  which  also 
presents  our  conclusions  and  recommendations.  Section  3 briefly  covers  the 
basic  principles  of  coherent  optical  correlation  and  Section  4 describes  the 
Image  Matched  Filter  (COMAP)  System,  various  modifications  made  to 
the  system  and  alignment  procedures.  Experimental  techniques  including 
filter  optimization  input  preprocessing  and  data  collection  are  presented  in 
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SECTION  II 

SUMMARY  AND  CONCLUSIONS 

In  this  section,  we  briefly  discuss  important  characteristics  of  a 
COMAP  system,  summarize  our  experimental  results,  and  present  our 
conclusions  and  recommendations.  Relevant  supporting  material  is  found  in 
subsequent  sections  of  this  report;  in  particular,  Section  7,  which  presents 
direct  comparison  of  a COMAP  and  AS-11B  parallax  measurements. 

2.  1 AUTOMATIC  STEREOCOMPILATION 

Parallax  differences  in  stereoscopic  aerial  photographs  are  used 
to  determine  ground  elevation.  Originally,  manual  stereoplotters  or 
stereocomparitor s were  used  to  measure  parallax  in  stereo  photographs  and 
produce  contour  lines  or  profile  data.  This  method  of  stereocompilation  is 
slow  and  requires  the  availability  of  highly  skilled  personnel  and  relatively 
precise  and  expensive  equipment.  Over  the  past  two  decades,  several  auto- 
matic stereocompilation  systems  have  been  developed.  For  the  most  part, 
these  systems  are  based  on  scanning  the  aerial  photos  with  a small  spot  and 
electronically  cross-correlating  the  resulting  video  signals.  Whereas  these 
electronic  correlation  systems  have  been  increasingly  successful,  there 
still  exists  room  for  improvement  in  various  operational  characteristics  and 
cost.  Therefore,  it  is  desirable  to  explore  alternative  approaches  to  auto- 
matic stereocompilation  which  may  avoid  some  limitations  associated  with 
electronic  correlation  schemes.  In  particular,  coherent  optical  data 
processing  (ODP)  is  an  attractive  method  for  automatic  parallax  measure- 
ment and  it  offers  some  unique  advantages. 

An  automatic  stereocompiler  based  on  ODP  can  offer  speed  and 
accuracy  equal  to  or  surpassing  electronic  correlators.  Most  importantly, 
a coherent  optical  mapping  (COMAP)  system  can  automatically  reacquire 
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on  the  COMAP  system.  The  final  two  data  runs  showed  r.m.s.  differences  of  24m 
and  30u  (model  coordinates)  between  COMAP  and  AS-11B  parallaxes  when 
rotational  and  translational  biases  were  removed.  This  is  remarkably  good 
agreement,  especially  in  view  of  the  fact  that  the  COMAP  and  AS-llB  scans 
were  not  exactly  coincident  and  the  AS-llB  data  itself  contained  an  uncertainly 
of  approximately  10M.  Moreover,  the  relatively  unsophisticated  instrumen- 
tation of  the  COMAP  system  undoubtedly  yielded  less  accuracy  than  the 
system  is  actually  capable  of  producing. 

Details  of  the  reduction  and  evaluation  of  the  COMAP  parallax 
data  are  presented  in  Section  7 of  this  report,  where  several  examples 
of  COMAP  and  AS-llB  parallax  profiles  are  given. 


2.  3 


CONCLUSIONS 


The  basic  feasibility  of  using  coherent  optical  techniques  for 
automatic  stereo  compilation  has  been  demonstrated  in  this  study.  Analytical 
arguments  indicate  that  a COMAP  type  system  should  be  at  least  as  accurate 
as  one  based  on  electronic  correlation;  this  is  supported  by  the  good  agree- 
ment between  COMAP  and  AS-llB  data.  The  potential  speed  of  a coherent 
COMAP  system  should  also  equal  or  better  that  of  a system  requiring  physical 
motion  of  the  input  photographs.  The  primary  limitation  on  the  speed  of  an 
optical  correlator  appears  to  be  that  imposed  by  the  output  detector  and 
development  of  an  adequate  detection  system  could  lead  to  a very  high  speed 
system  (over  100  mni^/sec  coverage). 

One  of  the  most  important  advantages  of  a COMAP  system  is  that 
it  will  not  get  "lost"  as  a result  of  abrupt  changes  in  parallax  or  in  regions  of 
poor  correlation  caused  by  lack  of  image  detail.  This  results  from  the  fact 
that  the  system  cross  correlates  a small  region  with  an  entire  frame  rather 
than  with  another  small  region.  This  avoids  the  image  overlap  or  lock-in 
problem  associated  with  image-to-image  correlators  such  as  the  AS-ll. 
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The  ability  to  avoid  getting  lost  should  allow  a COMAP  system  to  maintain  a 
high  average  throughput  rate  and  can  minimize  or  eliminate  the  need  for 
human  intervention  during  parallax  data  collection. 


A COMAP  system  has  the  interesting  property  that  it  can  readily 
be  scaled  in  size  without  appreciably  affecting  the  accuracy  of  parallax 
measurements.  Consequently,  it  is  possible  to  conceive  of  a small,  field- 
size  version  of  a COMAP  system  designed  for  tactical  use  at  a forward 


reconnaissance  base. 


RECOMMENDATIONS 


The  positive  experimental  results  to  date  and  the  potential  of  the 
COMAP  concept  in  terms  of  cost,  speed,  and  operational  flexibility  justify 
further  development  of  this  system.  The  present  breadboard  system  should 
be  more  fully  instrumented  and  brought  up  to  a quasi-operational  status.  The 
degree  of  automation  added  to  the  breadboard  should  be  such  that  it  is  pos- 
sible to  gather  large  amounts  of  parallax  data  in  a timely  manner.  Then 
the  system  can  be  used  to  generate  a number  of  photogramme  trie  models 
using  different  types  of  imagery  (vertical  frame,  convergent  pan,  etc.  ). 

This  will  provide  a firm  basis  for  estimating  the  actual  performance  which 
can  be  expected  from  an  operational  COMAP  system. 


SECTION  III 


PRINCIPLES  OF  COHERENT  OPTICAL  CROSS  CORRELATION 

Coherent  optics  has  a natural  application  to  the  processing  of 
two-dimensional  imagery.  Most  significantly,  optical  processing  allows 
parallel  cross  correlation  of  large  quantities  of  data  at  high  speeds. 
Sequential  frame  aerial  photography  is  ideally  suited  to  the  input  require- 
ments of  an  optical  processor. 

Automatic  techniques  for  extracting  prallax  information  from  a 
stereo  pair  typically  involves  cross  correlating  a small  portion  of  one  trans- 
parency with  a second  transparency.  The  position  of  the  resulting  cross 
correlation  peak  gives  a direct  measure  of  the  resultant  parallax  in  photo 
coordinates.  In  this  section  we  will  discuss  the  basic  principles  of  using  a 
coherent  optical  system  to  perform  cross  correlation. 

3.  1 GENERAL 

The  cross-correlation  operation  gives  the  be3t  linear  estimate  of 
the  similarity  between  two  function.  Stated  mathematically,  the  cross- 
correlation between  f(x,  y)  and  h(x,  y)  is 

00 

r(u,  v)  = J J f(x,  y ) h(u+x,  v+y)  dxdy  (1) 

• CO 

Although  the  integrals  in  (1)  are  over  infinite  limits,  it  is  understood  that 
f(x,  y)  and  h(x,  y)  are  of  finite  extent. 

The  correlation  function  r(u,v)  is  a measure  of  the  degree  of 
similarity  between  f(x,  y)  and  h(x,  y)  as  a function  of  the  displacement 
variables  (u,  v).  If  the  reference  function  h(x,  y)  is  contained  in  the  frame 
f(x,  y).  r(u.  v)  will  be  a maximum  at  a specific  set  of  values  for  u and  v; 
these  values  can  then  be  used  to  locate  h(x,  y)  relative  to  f(x,  y). 
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The  correlation  procedure  requires,  therefore,  that  r(u,  v)  be 
calculated  for  each  value  of  u and  v,  and  that  the  location  of  the  maximum 
value  of  r(u,  v)  be  located. 

Aerial  photographs  contain  a tremendous  amount  ot  information, 
typically  over  108  bits  per  frame.  This  amount  of  information  is  easily 
handled  by  an  optical  system  but  represents  a significant  problem  for 
digital  techniques.  Since  the  optical  system  is  an  analog  device,  quantizing 
and  digitizing  errors  are  net  encountered  in  the  calculation  of  r(u,  v).  It  is 
a parallel  processor  and  is  ideally  suited  for  correlation  of  two-dimensional 
photography  because  of  its  inherent  two-dimensional,  nonscanning  nature. 

3.2  COHERENT  OPTICAL  SYSTEMS 

Both  incoherent  and  coherently  illuminated  optical  systems  have 
been  used  to  evaluate  the  correlation  function  r(u,  v)  as  given  in  (1).  The 
arrival  of  CW  gas  lasers  as  powerful  and  economical  sources  of  spatially 
and  temporarily  coherent  light  make  coherently  illuminated  systems 
practical  and  the  clear  choice  over  incoherently  illuminated  systems.  Their 
superiority  arises  from  their  ability  to  display  the  Fourier  transform  of  a 
two-dimensional  input  function  so  that  the  transform  can  be  modified  by  a 
spatial  filter  and  the  corresponding  filtering  operation  effected  simultaneously 
over  the  entire  input  function. 

Figure  3- la  shows  the  basic  elements  of  a coherent  optical  data 
processing  system.  In  describing  the  operation  of  the  system  we  shall 
assume  that  photographic  transparencies  are  used  to  input  the  data  and  for 
recoiding  filters.  A point  source  of  monochromatic  light,  collimated  by 
lens  Lc,  illuminates  f(x,  y)  which  represents  the  data  to  be  processed. 

A spherical  lens  Li  displays  the  two-dimensional  Fourier  transform 
F(P»  q)  of  f(x*y)  at  its  back  focal  plane  P2.  Although  the  Fourier  trans- 
form relationship  exists  for  a wide  range  of  axial  positions  of  f(x,  y),  the 
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optimum  position  of  f(x,  y)  is  at  the  front  focal  plane  of  Lx.  A spatial 


filter  having  transmittance  T(p,  q)  can  be  placed  in  plane  P2  to  modify 
F(p,  q)  directly.  The  amplitude  r(u,  v)  of  the  light  in  the  output  plane  of 
the  optical  system  is  the  Fourier  transform  of  the  wavefront  emerging  from 
the  filter,  i.  e.  , 


r<u>v)  jf  F(p,q)  T(p,  q)  e‘:’(pX  + qy)  dpdg.  (2) 

A 

The  spatial  frequency  variables  p and  q are  related  to  the  space  coordin- 
ates in  the  plane  P2  by  the  relationships 


(3) 


where  \ is  the  wavelength  of  the  illumination  and  Fx  is  the  focal  length 
of  Lj.  If  we  apply  the  convolution  theorem  to  the  cross-correlation 
Eq.  (1),  we  find  that 


1 ^ 

r(ufv)  = J J f(x,y)t(u-x,  v-y)  dxdy. 


and,  if  t(x,  y)  = h(-x, -y),  Eqs.  (4)  and  (1)  are  identical.  Equation  (2) 
shows  that  the  appropriate  filter  function  T(p,  q)  to  be  placed  in  plane  Pa 

is  the  conjugate  of  the  Fourier  transform  of  the  reference  function;  i.  e.  , 

* 

H (p,  q).  The  cross-correlation  function  r(u,  v)  is  then  formed  by  a second 
Fourier  transform;  lens  L2  is  used  for  this  purpose. 

' The  required  filter  function  H (p,  q)  can  be  constructed  as  a 
spatial  carrier-frequency  filter.  Figure  3-  lb  shows  a filter-generator  in  which 
h(x,y)  is  placed  in  plane  Px  and  illuminated  by  a plane  wave  of  monochro- 
matic light.  Lens  Lx  displays  the  Fourier  transform  H(p,  q)  at  its  back 
focal  plane.  A reference  beam  of  light,  denoted  by  A expjjpb],  is  added 
to  H(p,q)  and  the  intensity  of  the  sum  of  these  two  light  beams  is  recorded 
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on  a high  resolution  photographic  film  or  other  suitable  recording  medium 
(e.  g.,  a plastic  device).  The  light  intensity  at  plane  P2  is 

|(i(p,  q)  f |Aejpb  t 11  ( p , q ) I** 

Aa  i |ll(p,  q)  1“’  * Ae‘Jpb  H(p,  q)  * Ae^1  ll"(p,q),  (*>) 


where  b - Fi  tan  (X. 

Because  a coherently  illuminated  optical  system  is  linear  in  light 
amplitude,  we  want  to  relate  the  amplitude  transmittance  of  the  recorded 
filter  to  the  incident  exposure.  We  characterize  the  linear  portion  of  the 
amplitude  transmittance  versus  exposure  curve  of  a film  by 

T = T - pE,  (6) 

a o 

whera  T is  the  amplitude  intercept  and  ? is  the  slope  of  the  straight 
line.  By  substituting  (5)  into  (6),  we  have 

Ta(p.q>  = [-P  (A3  - To/pt)+  tH(P.q)|  = 

t Ae"ipb  H(p,q)  + ^e,pb  H*<p,q>].  (7) 

* 

Note  that  the  last  term  of  (7)  contains  the  desired  filter  function  H (p.q); 
i,  remain,  to  be  shown  that  this  term  can  be  separated  from  the  others. 

After  exposure  and  development,  the  filter  T^ip, q)  is  placed  in 
plane  Ps  of  the  optical  system  shown  in  Figure  3- la  and  is  illuminated  by 
F(p,  q).  At  the  output  plane  P3  of  the  processor,  we  observe  three  filtered 

versions  of  the  input  data: 
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ri(-u,.v)  -Ij-  J-J  F(p,q)[(AS  . Topt)+  |H(p.,)!=]e-i,P"+'5v|dpdq 


IP  .f.IXp.q)  H(p,q)o-'[l’<,-b|  1 r'dpdq 


r3(-u,  -v) 


4tt" 


JTK(|..q)ll'(|..q)e-jl',<u,b)  1 "'l  dpdq. 


(8) 


The  first  term  of  (8),  centered  on  the  optical  axis,  is  generally  of  no  interest. 

The  second  term,  centered  at  u -b,  represents  the  convolution  of 
f(x,  y)  with  h(x,y).  The  thir  ’ -rm,  centered  at  u = +b,  represents  the 
desired  cross-correlation  of  , y)  and  h(x,  y).  If  we  bear  in  mind  that 
r^"u'  -v)  is  centered  at  + b,  we  may  rewrite  the  third  term  as 


r3(-u,-v>  JjF(p,q|H*(p1,).-),Pn4'llrldpd,,  (9) 

- 00 

which,  through  the  use  of  the  convolution  theorem,  is  identical  to  (1). 

The  coordinates  (u,  v)  in  plane  P3  have  reversed  signs  as  a consequence 
of  the  fact  that  a positive  spherical  lens  always  introduces  a negative  kernal 
function  in  the  Fourier  transform  operation.  The  negative  coordinates  imply 
that  the  filtered  image  is  rotated  through  180  degrees,  a natural  result  ob- 
tained from  any  imaging  system  whether  coherently  or  incoherently  il- 
luminated. 

3.  3 PARALLAX  MEASUREMENT 

A coherent  optical  correlator  is  used  to  determine  parallax  by 
cross-correlating  small  regions  in  a stereo  pair  of  transparencies.  Let  us 
assume  that  one  transparency  h(x,  y)  from  a stereo  pair  is  used  to  make  a 


15 


m 


-r-Mi,  ynirfWi  liri— 


■m  .u 


spatial  filter  as  described  above.  The  second  transparency,  f(x,  y)  and  this 
filter  are  located  in  planes  Pi  and  Pa  respectively  of  the  system  shown 
in  Figure  3- la. 

(f  only  a small  area  of  the  second  transparency  is  illuminated, 
the  output  plane  P3  will  contain  a light  intensity  pattern  corresponding  to 
the  cross  correlation  of  this  illuminated  area  with  that  of  the  entire  first 
transparency.  Ideally,  any  given  small  area  (A^)  will  cross  correlate 
strongly  with  only  the  corresponding  small  area  (A^)  on  the  first  trans- 
parency. The  position  of  the  cross  correlation  peak  in  plane  P3  is  fixed  by 
the  relative  positions  of  these  two  small  areas  (A^  and  A^.)  in  the  input 
gate.  Any  change  in  position  for  this  region  between  the  filter  making  oper- 
ation and  the  cross  correlation  operation  will  cause  a corresponding  dis- 
placement shift  of  the  correlation  peak  in  the  output  plane.  This  correlation 
position  shift  can  be  used  to  measure  the  parallax  between  the  local  regions. 

By  sequentially  illuminating  portions  of  the  second  transparency, 
f(x,y),  and  detecting  the  positions  of  the  corresponding  correlation  peaks, 
we  can  measure  parallax  over  the  entire  input  scene. 
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SECTION  IV 
COMAP  SYSTEM 

A major  task  in  this  study  was  the  evaluation  and  modification  of 
the  breadboard  Image  Matched  Filter  System  (COMAP)  provided  by 
RADC.  This  section  of  the  report  describes  the  system  and  some  of  the 
more  significant  modifications  performed  by  us.  While  we  'vere  able  to 
considerably  improve  the  performance  of  the  system  and  obtain  good 
parallax  data,  some  further  modifications  are  desirable.  Techniques  used 
in  aligning  and  calibrating  the  system  are  also  described  in  this  section. 

4.  1 GENERAL  CONFIGURATION 

During  this  study,  the  COMAP  system  went  through  a series  of 
evolutionary  changes  involving  the  modification  or  relocation  of  some  of 
the  original  components  as  well  as  the  addition  of  some  of  our  in-house 
equipment.  However,  the  general  configuration  and  function  of  the  system 
did  not  change  substantially  and  only  the  final  system  arrangement  will  be 
described  in  detail.  A minicomputer  was  interfaced  to  the  COMAP  system 
to  aid  in  data  collection. 

The  COMAP  system  used  in  this  study  operates  in  two  different 
modes:  the  filter  generation  mode  or  the  data  collection  mode.  The  experi 
mental  set  up  of  the  system  is  shown  in  the  line  diagrams  of  Figures  4-1 
through  4-3.  Figure  4-1  shows  the  configuration  for  filter  generation, 
while  Figure  4-2  shows  the  system  layout  for  the  data  collection  mode. 
Figure  4-3  schematically  illustrates  the  minicomputer  interface. 

The  COMAP  processor  was  set  up  on  a pneumatically  supported 
table.  The  components  necessary  for  both  modes  of  operation  are  present 
simultaneously  on  the  table,  and  the  interchange  between  modes  is  easily 
accomplished  by  repositioning  only  two  mirrors:  the  beam  routing  mirror 
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FIGURE  4-3.  COMAP  SYSTEM:  COMPUTER  AND  OPERATOR  INTERFACE 


1 


. 


and  the  scanning  mode  mirror  Ms.  A lens-pinhole  assembly  determines 
the  correct  orientation  of  f and  fixed  stops  locate  M2. 


In  the  filter  generation  mode  (Figure  4-1),  the  514.  5 nm  light  from 
a Spectra  Physics  165  Argon  ion  laser  is  directed  into  the  system  by  beam 
routing  mirror  M1#  The  incident  laser  beam  is  split  into  a signal  and  a 
reference  beam  by  a beamsplitter.  The  reference  beam  is  then  spatially 
filtered  and  collimated  with  its  axis  at  an  angle  of  38.  5°  to  the  signal  beam 
axis.  The  signal  beam  is  also  expanded  and  filtered  by  a lens-pinhole 
assembly  and  collimated  by  lens  L . This  collimated  light  is  incident  on 
the  liquid  gate  G which  contains  a transparency  (aerial  photograph)  for 


which  a matched  filter  is  to  be  produced.  The  lens  L,^,  forms  the  Fourier 


transform  of  the  input  transparency  in  the  filter  plane.  The  axes  of  the 
reference  and  signal  beams  intersect  at  the  filter  plane. 


The  optical  system  arrangement  for  data  collection  is  shown  in 
Figure  4-2.  The  beam  routing  mirror  is  reoriented  so  that  all  of  the 

laser  light  is  directed  to  a telecentric  galvanometer  scanner.  The  beam 
in  this  case  is  formed  in  a narrow  cone  which  illuminates  an  area  ap- 
proximately 1 mm  in  diameter  in  the  input  gate.  The  scanning  beam 
routing  mirror  Ma  is  translated  into  position  against  fixed  stops  when  con- 


vc  i Tng  to  the  data  collection  mode. 


The  telecentric  scanner  consists  of  two  small  galvanometers  with 
axes  at  right  angles  and  whose  mirrors  ar^  in  the  conjugate  planes  of  a 
folded  telescope.  The  scanner  is  positioned  so  that  the  scanning  beam  pin- 
hole is  imaged  onto  the  center  of  both  mirrors.  This  assures  that  the 
scanning  beam  always  appears  to  come  from  the  same  point  regardless  of 
the  direction  in  which  it  is  deflected.  The  scanner  and  scanning  beam  optics 
are  arranged  so  that  the  scanning  beam  is  collimated  at  the  input  gate. 
Hence,  the  scanning  beam  pinhole  is  optically  at  the  same  position  with  re- 


spect to  Lc  as  is  the  signal  beam  pinhole  in  the  filter  generation  mode; 
i.e.  , one  focal  length  away. 
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The  Fourier  transform  lens  L and  the  collimator  L forma 

c 

telescope  which  images  the  scanning  beam  source  in  the  filter  plane.  When 
the  system  is  properly  aligned,  this  image  of  the  scanning  beam  source  is 
stationary  regardless  of  the  position  the  scanning  beam  in  the  input  gate. 

The  spatial  filter,  when  illuminated  by  a wavefront  derived  from 
a matched  area  from  the  input  transparency,  reconstructs  a modified  version 
of  the  original  reference  beam  at  a nominal  angle  of  38.  5°  to  the  optical  axis. 
This  beam  is  reflected  by  the  mirror  to  the  lens  L which  forms  the  cross 
correlations  in  the  output  (correlation)  plane.  This  lens  and  mirror  are 
mounted  on  a small  auxiliary  optical  rail  attached  to  the  optical  table. 

A vidicon  camera  mounted  on  an  X-Y  translation  device  is  used 
for  measuring  the  locations  of  correlation  peaks.  Parallax  measurements 
are  made  by  translating  the  vidicon  until  the  correlation  peak,  as  viewed  on 
a TV  monitor,  is  centered  on  a pair  of  electronic  cross  hairs.  A precision 
linear  potentiometer  on  each  axis  of  the  camera  translation  device  is 
connected  to  a digital  multimeter  arranged  to  measure  resistance  in  a ratio 
mode.  The  least  count  on  the  digital  meter  corresponds  to  a translation  of 
1.  5pm. 

The  scanner's  galvanometers  are  interfaced  to  a minicomputer  by 
means  of  two  12-bit  D/ A converters.  We  developed  software  to  provide 
correction  for  the  non-linear  nature  of  the  galvanometer  scanner  which 
allowed  the  operator  to  simply  type  in  the  photocoordinates  of  any  desired 
point.  The  computer  also  provided  a convenient  and  rapid  means  for  step- 
ping along  a given  scan  line,  or  sequentially  addressing  a series  of  control 
points. 

4.  2 SYSTEM  MODIFICATIONS 

The  final  configuration  of  the  COMAP  system  as  described  above 
came  about  after  a series  of  modifications  to  the  original  equipment. 
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These  modifications  represented  a considerable  portion  of  the  effort  ex- 
pended in  this  study  and  resulted  in  improved  system  performance. 


We  found,  upon  assembly  of  the  COMAP  system,  that  although 
the  overall  construction  of  the  optical  system  appeared  good,  there  were 
several  problem  areas  which  limited  the  performance  of  the  system.  These 
areas  included  stability  of  the  optical  bench,  thermal  effects  in  the  liquid 
gate,  and  the  correlation  detection  optics.  These  problems  were  corrected 
and  the  optical  system  was  modified  wherever  necessary.  Each  problem  is 
discussed  briefly  in  this  section. 

The  first  step  necessary  to  obtain  good  spatial  filters  is  to  es- 
tablish a stable  optical  bench.  This  is  particularly  true  for  the  high  offset 
angle  of  the  COMAP  system.  We  found  it  was  necessary  to  bolt  each  com- 
ponent firmly  to  the  table  and  ensure  that  the  supporting  table  legs  were 
correctly  aligned.  It  was  also  necessary  to  isolate  the  laser  by  installing 
rubber  pads  under  it  and  by  suspending  the  umbilical  cord  in  order  to 
eliminate  vibrations  caused  by  the  flow  of  cooling  water.  The  original 
system  included  a small  cantilevered  table  extension  which  supported  the 
reference  beam  turning  mirror.  This  assembly  tended  to  vibrate  and  it 
proved  necessary  to  remove  it  and  replace  the  small  mirror  by  a larger 
mirror  clamped  directly  to  the  main  optical  bench.  Subsequent  to  these 
modifications,  the  system  stability  was  verified  by  generating  a filter 
over  the  full  4-inch  by  5-inch  field.  Although  no  attempt  was  made  to  opti- 
mize the  filter  recording  parameters,  the  filter  reconstructed  well  over  the 
entire  area. 

Thermal  lensing  in  the  liquid  gate  was  caused  by  beam  heating  of 
the  index  matching  fluid.  The  laser  beam  has  a Gaussian  intensity  profile 
which  induces  a local  thermal  profile  of  approximately  the  same  form.  The 
liquid's  index  of  refraction  varies  with  temperature  and  in  turn  produces  a 
lens -like  phase  shift  on  the  light  passing  through  this  region  of  the  gate. 


The  net  effect  of  this  phe„ome„a  is  to  induce  a significant  shift  the 
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monitored  by  a pair  of  digital  multimeters.  This  arrangement  provided 
improved  resolution  (approximately  1.  5pm  per  least  count). 

The  original  telecentric  scanner  consisted  basically  of  two 
galvanometers  and  a pair  of  lenses  mounted  on  a small  optical  rail  which 
extended  off  one  side  of  the  main  optical  table.  This  arrangement  proved 
difficult  to  align  and  was  a minor  hazard  to  personnel.  Consequently,  we 
designed  and  built  the  more  compact  scanner  illustrated  schematically  in 
Figure  4-4.  The  horizontal  mirror  and  the  lens  form  a unit  power  telescope 
which  images  the  galvanometer  mirrors  onto  each  other.  The  mirror  can  be 
tilted  in  two  axis  and  translated  vertically  for  alignment  and  focusing.  The 
lens -mirror  combination  can  be  translated  vertically  for  focusing.  Each 
galvanometer  can  be  tilted  about  two  axis  perpendicular  to  the  mirror  shaft 
(pitch  and  yaw).  The  entire  scanner  is  mounted  on  a translation  stage  for 
positioning  with  respect  to  the  collimator  lens.  This  device  is  relatively 
compact  and  has  proved  adequate.  The  galvanometers  themselves,  however, 
suffer  from  drift,  hystresis,  and  gain  changes.  Use  of  thermally  compen- 
sated galvanometers  with  position  feedback  is  essential  if  truly  reliable 
operation  is  to  be  achieved. 

4.  3 OPTICAL  SYSTEM  ALIGNMENT 

Proper  alignment  and  calibration  of  the  system  are  required  in 
order  to  produce  accurate  and  repeatable  results.  This  section  discusses  the 
basic  steps  required  to  align  the  COMAP  system  in  both  the  filter  generation 
and  data  collection  (scanning)  mode.  When  properly  aligned,  the  system 
can  quickly  be  changed  from  one  mode  to  the  other  without  any  need  for 
significant  adjustments. 

Alignment  of  the  signal  beam  is  somewhat  complex  while  that  of 
the  reference  beam  is  comparatively  simple.  The  major  steps  involved  in 
system  alignment  are  described  briefly  below.  The  terms  horizontal  and 
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FIGURE  4-4.  FOLDED  TELECENTRIC  SCANNER 


vertical  will  be  used  to  designate  directions  parallel  and  vertical  to  the 
surface  of  the  optical  bench  which  may  or  may  not  be  truly  horizontal. 


The  large  Fourier  transform  lens  is  first  shimmed  so  that  ts 
optical  axis  is  horizontal;  any  of  a number  of  obvious  procedures  can  be 
used  for  this  step.  All  major  optical  components  are  placed  in  their  ap- 
proximate positions,  except  for  the  microscope-pinhole  assemblies  and  the 
referau  e beam  collimator  which  are  temporarily  omitted.  An  auxiliary 
alignment  laser  is  mounted  so  that  its  beam  is  directed  backward  through 
the  system  (i.  e.  from  the  filter  plane  to  the  collimator,  etc.  ).  This  laser 
beam  is  made  colinear  with  the  optical  axis  of  the  large  lens  by  means  of  the 
reflections  from  the  surfaces  of  the  lens  (Boys'  point  method  of  alignment). 
The  signal  beam  collimator  axis  is  then  made  colinear  with  the  laser  beam 
using  Boys'  method.  The  signal  beam  routing  mirrors  and  beamsplitter 
are  then  adjusted  so  that  the  beam  from  the  Argon  laser  is  colinear  with  that 


of  the  alignment  laser  beam. 

The  signal  beam  pinhole  assembly  is  then  introduced  and  adjusted 
so  that  the  collimator  produces  a uniform,  collimated  beam.  A convenient 
method  for  checking  beam  collimation  is  to  observe  the  interference 
pattern  between  the  front  and  back  surfaces  of  a high  quality  beamsplitter. 
When  straight  fringes  are  obtained,  the  pinhole  is  at  the  correct  distance 
from  the  collimator  and  the  beam  is  collimated.  The  signal  beam  will  then 
be  focussed  to  a point  in  the  center  of  the  filter  plane. 


The  reference  beam  is  then  aligned  by  positioning  the  necessary 
mirrors  so  that  the  unexpanded  Argon  laser  beam  pierces  the  center  of  the 
filter  plane.  The  output  routing  mirror  and  inverse  transform  lens  are 
aligned  next.  The  reference  beam  collimator  is  then  placed  in  the  system 
and  adjusted  so  that  its  optical  axis  is  aligned  with  the  reference  beam. 
The  reference  beam  pinhole  assembly  is  then  introduced  and  aligned  to 
produce  a collimated  reference  beam.  The  point  at  which  this  beam  is 
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FIGURE  4-6.  I NT  ENSITY  OF  SCANNING  BEAM  IN  INPUT  PLANE 


just  behind  the  input  gate.  This  Hartman  mask  creates  four  Airy  discs  at 
the  plane  of  focus.  The  microscope  is  focused  so  that  these  four  Airy  discs 
overlap  exactly;  this  defines  precisely  the  filter  plane.  The  Hartman  test 
was  necessary  because  of  residual  spherical  aberration  in  the  signal  beam 
(see  Appendix  B).  The  filter  holder  should  now  be  focussed  in  the  filter 
plane. 

The  mirror  M2  is  replaced  for  scanner  alignment.  The  galvan- 
ometer mirror  nearest  the  collimator  is  oscillated  and  the  scanning  spot 
observed  in  the  filter  plane.  The  scanner  is  translated  until  the  spot  re- 
mains stationary.  This  assures  the  final  galvanometer  mirror  is  properly 
focussed  into  the  filter  plane.  The  other  galvanometer  mirror  is  now 
scanned  and,  if  necessary,  the  galvanometer  lens  and  mirror  adjusted  until 
the  spot  is  again  stationary.  Iterative  adjustment  of  scanner  position  will 
be  necessary  to  position  the  scanning  beam  spot  on  the  center  of  the  filter 
plane.  A final  small  correction  may  be  made  using  the  mirror  Ma,  but 
this  should  be  minimized  or  avoided  completely. 

The  scanning  beam  must  be  collimated  as  it  passes  through  the 
input  gate.  This  is  accomplished  by  adjusting  the  beam  forming  optics  and 
pinhole.  Since  it  is  difficult  to  verify  the  collimation  of  a 1 mm  diameter 
beam  by  direct  observation,  the  following  procedure  was  adopted  (see 
Figure  4-7). 

The  system  is  put  in  the  filter  generation  mode  and  a grating  of, 
say,  50  Jjpmm  is  placed  in  or  near  the  input  plane.  A photographic  plate 
in  the  filter  holder  is  exposed  to  record  the  spectrum  of  this  grating.  To 
avoid  any  possibility  of  space-variant  distortion  of  the  spectra,  the  grating 
should  be  covered  with  a mask  limiting  its  illumination  to  a small,  central 
region.  The  photographic  plate  is  developed  and  replaced  in  the  filter  plane. 
The  system  is  returned  to  the  scanning  mode  with  the  grating  still  in  place. 
The  location  of  the  spectral  orders  are  observed  with  a microscope  as  the 
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FIGURE  4-7.  SCANNING  BEAM  COLLIMATION  TECHNIQUE 


beam  forming  optics  are  adjusted.  When  the  beam  is  properly  collimated, 
the  spectral  orders  will  exactly  coincide  with  those  recorded  on  the  plate. 


34 


If 


SECTION  V 


EXPERIMENTAL  TECHNIQUES 

This  section  covers  optimization  of  spatial  filter  performance, 
input  preprocessing  and  data  collection.  Good  spatial  filter  performance  is 
necessary  for  adequate  correlation  performance.  Fortunately,  the  filter 
optimization  procedure  is  straightforward  and  its  performance  shows  a 
reasonable  tolerance  of  variations  in  filter  recording  parameters.  In  the 
course  of  performing  correlation  experiments,  we  found  that  a form  of  input 
preprocessing  called  "silver  masking"  considerably  improved  system  per- 
formance. We  developed  parallax  data  collection  procedures  which  were 
designed  to  minimize  the  effects  of  certain  system  insufficiencies.  The 
good  agreement  between  COMAP  and  AS- 11  data  indicates  that  these 
procedures  were  successful. 


5.  1 SPATIAL  FILTER  OPTIMIZATION 

The  matched  filter,  or  Fourier  transform  hologram,  is  the  most 
important  element  of  the  system  and  its  performance  determines,  to  a great 
extent,  the  performance  of  the  overall  system.  Perhaps  the  principal 
advantage  of  a holographic  filter  is  that  it  performs  a true  complex  cross- 
correlation. That  is,  it  operates  on  both  the  amplitude  and  phase  of  the  in- 
coming wavefront.  A properly  recorded  filter  can  be  made  to  exhibit  band- 
pass characteristics  and  effectively  enhance  the  response  of  the  system  to 
the  fine  details  of  photographs;  then  accurate  parallax  measurements  can 
be  made.  That  is,  a spatial  filter  can  be  made  which  rejects  low-frequency 
information  while  capturing,  faithfully,  information  associated  with  edges 
and  details.  The  frequency  band  must  be  carefully  selected  because  we  do 
not  wish  to  lose  cross-correlation  between  corresponding  regions  due  to 
relatively  minute  changes  in  their  appearance. 


The  two  most  important  parameters  in  the  filter  construction 
process  are  exposure  and  the  ratio  of  reference  to  signal  beam  (K-ratio). 

One  of  the  light  beams  impinging  upon  the  photographic  emulsion  during  the 
filter  recording  process  is  the  Fourier  transform  of  an  aerial  photograph. 
This  is  a light  distribution  having  its  greatest  intensity  at  its  center  and 
tapering  off  rapidly  toward  the  edges.  The  extent  and  manner  in  which  this 
spectrum  varies  with  distance  from  the  center  of  the  filter  --  that  is,  with 
inc  reasing  spatial  frequency  --  is  determined  by  the  characteristics  of  the 
input  transparency.  High-resolution  imagery  will  produce  a spectrum  which 
is  relatively  intense  at  higher  spatial  frequencies.  If,  on  the  other  hand, 
the  input  image  lacks  fine  high- resolution  detail,  more  and  more  of  the 
light  will  be  concentrated  toward  the  lower  frequencies.  The  enormous 
dynamic  range  of  a spectrum  makes  it  almost  impossible  to  record  it  all 
faithfully  in  a hologram.  The  reason  for  this  can  be  seen  by  recalling  that 
the  hologram  is  essentially  a recording  of  the  intensity  of  the  light  pattern 
created  by  the  interference  of  two  beams.  If  these  beams  are  of  equal  in- 
tensity, the  fringes  created  by  them  will  tend  to  have  100  percent  modulation. 
If,  however,  one  of  the  beams  is  considerably  stronger  than  the  other,  the 
depth  of  modulation  of  the  fringes  will  be  correspondingly  less.  Finally, 
because  of  the  limited  dynamic  range  of  real  photographic  emulsions, 
beams  of  extremely  different  intensities  will  produce  fringes  of  such  low 
modulation  that  they  will  be  lost  in  the  noise  of  the  emulsion  itself.  That  is, 
the  reference  beam  can  be  adjusted  to  maximize  the  modulation  of  the  inter- 
ference fringes  only  over  a limited  region  of  the  spatial  frequency  domain. 
However,  this  will  mean  sacrificing  other  regions  of  the  frequency  domain. 

In  general,  the  low-frequency  information  contained  in  an  aerial 
photograph  is  not  useful  in  obtaining  high-quality  cross-correlations.  Con- 
sequently, a spatial  filter  should  be  recorded  to  maximize  its  response  at 
higher  frequencies  and  to  minimize  or  suppress  its  response  at  low  spatial 
frequencies.  This  is  done  Bimply  by  adjusting  the  reference  beam  to  a 
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value  which  matches  approximately  the  intensity  of  the  spectrum  in  a spatial 
frequency  band  of  interest.  The  photographic  emulsion  is  exposed  to 
optimize  the  exposure  in  the  spatial  frequency  regions  of  interest.  This 
normally  results  in  overexposure  of  the  low-frequency  region  of  the  spectra 
producing  a filter  which  has  little,  if  any,  response  in  this  region.  The 
bandpass  characteristics  desired  in  a spatial  filter  are  determined,  to  a 
great  extent,  by  the  application  and  the  characteristics  of  the  imagery  to 
be  correlated.  Typically,  in  a photogrammetric  application,  it  is  unnecessary 
to  pass  any  frequencies  lower  than  the  reciprocal  of  the  diameter  of  the 
scanning  beam.  It  is  also  unnecessary,  and  even  undesirable,  to  pass 
frequencies  which  extend  beyond  the  practical  resolution  of  the  stereo 
imagery. 

An  experiment  was  performed  with  a typical  aerial  photograph  to 
optimize  the  exposure  for  a matched  spatial  filter.  A series  of  spatial 
filters  were  made  where  the  exposure  was  varied  from  40  to  1280  pj/cma 
and  the  signal-to-noise  ratio  (SNR)  of  the  correlation  peak  was  measured 
along  with  the  diffraction  efficiency.  Figure  5-1  shows  a graph  of  the  results 
where  the  exposure  is  plotted  versus  signal-to-ratio  and  the  diffraction  ef- 
ficiency of  the  correlation  peak.  Note  the  peak  SNR  and  the  peak  diffraction 
efficiency  occur  at  approximately  80  [iJ/cm2  exposure  which  is  nearly  the 
exposure  needed  to  produce  an  amplitude  transmittance  of  0.  5 for  an 
amplitude  hologram.  Therefore,  all  the  exposures  were  kept  at  approxi- 
mately 80  uJ/cm3. 

In  this  and  all  subsequent  measurements,  the  SNR  is  defined  as 
the  peak  signal  intensity  to  average  noise  intensity  where  the  noise  is 
defined  as  any  light  in  the  output  plane  v/hich  is  not  contained  in  the  actual 
correlation  peak.  The  noise  is  composed  of  the  cross -correlation  of  the 
filter  impulse  response  with  the  input  scene,  scattering  due  to  the  nonlinear 
characteristics  of  the  filter,  and  grain  noise  effects.  Of  these,  the  cross- 
correlation component  is  generally  the  most  significant. 
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Another  experiment  was  performed  to  optimise  the  reference-to- 
signal  beam  ratio  (K- ratio)  for  a typical  aerial  photograph  based  on  the 
SNR  produced  at  the  output  of  the  optical  system.  A series  of  six  filters 
was  made  where  the  K-ratio  was  *,  1.  2.  4.  8;  each  filter  was  exposed 

by  approximately  80  MJ/cm8.  The  SNR  of  the  resulting  autocorrelation  peak 
was  measured  by  means  of  a scanning  photomultiplier  with  an  18p  by  180p 
sampling  slit;  a 30 -inch  f/5  lens  was  used  as  the  inverse  transform  lens. 
Figure  5^2  shows  a graph  of  the  SNR  of  the  correlation  peak  as  a function 
of  the  K-ratio,  for  two  beam  sizes.  Note  that  for  a 5-7.  5 ipmm  bandpass 
annulus  used  to  measure  the  K-ratio,  a steady  increase  in  SNR  is  observed 
for  higher  K -ratios;  this  means  that  the  most  significant  contributions  from 
the  image  occur  at  spatial  frequencies  under  5 fpmm. 


The  above  optimization  experiments  were  performed  with  con- 
ventional copies  of  aerial  photographs.  Subsequent  experiments  with  pre- 
processed  imagery  (see  Section  5.2)  produced  similar  results.  In  this 
latter  case,  a reference  beam  exposure  of  46  uJ/cma  and  a K ratio  of  2 
measured  over  2.  5-5  ipmm  was  taken  as  optimum. 


It  is  important  to  note  that  filter  performance  is  relatively 
tolerant  to  variations  in  K ratio  and  exposure.  While  it  is  desirable  to  ap- 
proach the  optimum  for  recording  parameters,  a practical  range  of  values 
can  be  accepted.  Consequently,  automatic  control  of  the  filter-making 
operation  should  be  relatively  easy  to  implement. 


5.2  INPUT  PREPROCESSING 

Edge  detail  contrast  in  an  aerial  photograph  is  one  of  the  most 
important  factors  affecting  the  correlation  performance  of  a coherent  optical 
correlator.  Between  regions  of  equal  resolution,  those  areas  having 
greater  edge  detail  contrast  will  usually  produce  correlation  peaks  with  a 
better  signal-to-noise  ratio  than  do  areas  of  less  edge  contrast.  High 
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contrast  regions  not  only  have  more  energy  in  the  spatial  frequency  bands 
most  important  in  matched  filter  correlation,  they  also  produce  less  scat- 
tered noise  due  to  film  grain. 

A major  difficulty  in  obtaining  good  correlation  response  over  an 
entire  frame  is  that  gross  tonal  variations  use  the  major  part  of  the  trans- 
mission range  of  the  recording  material  and  edges  cannot  be  recorded  at 
maximum  contrast  throughout  the  entire  frame.  That  is,  to  record  detail 
in  scenes  which  have  areas  ranging  in  tone  from  bright  to  dark,  relatively 
low  gamma  films  are  used.  This  approach  preserves  detail  throughout  the 
entire  scene,  however,  it  means  that  edge  contrast  is  low,  especially  in 
regions  which  differ  significantly  from  the  average  brightness  of  the  scene. 

The  original  aerial  photo  cannot  be  simply  copied  on  a high  contrast  film  in 
order  to  enhance  edge  contrast  because  this  would  cause  a loss  of  detail  in 
some  regions.  However,  by  using  local  dodging,  a high  contrast  emulsion 
can  be  used  in  making  a copy  which  has  great  edge  contrast  while  preserving 
detail  throughout  the  picture. 

We  made  copies  of  the  Canadian  test  model  transparencies  using 
a "silver  mask"  technique  to  provide  local  dodging.  The  original  glass 
diapositives,  which  have  very  low  contrast,  were  placed  in  contact  (emulsion 
to  emulsion)  with  an  unexposed  photographic  plate  having  a high  contrast  emul- 
sion. A negative  copy  (the  silver  mask)  of  the  diapositive  was  placed  on  top 
of  the  diapositive.  A small,  distant  light  source  was  used  to  expose  the  plate 
through  the  combined  positive/negative  transparencies.  The  negative  trans- 
parency casts  a somewhat  unsharp  shadow  on  the  emulsion  of  the  dispositive. 
The  diapositive  in  turn  casts  a very  sharp  shadow  onto  the  unexposed  plate. 

On  a gross  scale,  the  transmissions  of  the  positive  and  negative  tend  to 
cancel  each  other  and  produce  an  almost  uniform  exposure.  However,  the 
sharp  edge  detail  of  the  diapositive  is  not  cancelled  since  the  shadow  of  the 
negative  is  not  sharp.  Hence,  edge  detail  and  contrast  is  preserved  while 


gross  tonal  variations  are  smoothed  out.  Proper  exposure  and  development 
of  the  high  contrast  plate  produces  a transparency  with  good  detail  and  high 
edge  contrast  throughout. 

Three  masking  techniques  were  used  to  prepare  three  sets  of  edge 
enhanced  stereo  pairs.  The  masks  were  negatives,  printed  on  a film  with 
T = 1 from  the  original  diapositive.  The  unity  gamma  allowed  the  negatives 
to  be  complementary  in  density  to  the  original  scenes.  The  techniques  used 
to  construct  the  masks  caused  differeing  amounts  of  spatial  frequency  content 
to  be  recorded.  The  masks,  in  order  of  decreasing  spatial  frequency  content, 
are  denoted  as  Type  1,  Type  2,  and  Type  3.  The  Type  1 masks  were  contact 
printed  from  the  original  master  scenes  with  the  film  emulsions  on  the  out- 
side of  the  film  sandwich.  Thus,  loss  of  resolution  was  introduced 
by  the  thickness  of  glass  between  the  emulsions.  Type  2 masks  were  con- 
structed similarly,  except  a weak  diffuser  was  also  inserted  between  the 
plates,  causing  further  loss  of  resolution.  Type  3 masks  were  exposed 
through  an  enlarger  to  a slightly  defocussed,  but  one-to-one,  image  of 
the  master  scene.  Type  3 masks  proved  to  have  artifacts  induced  by  the 
out-of-focus  condition. 

After  a number  of  trials  using  these  masks,  we  succeeded  in 
making  copies  of  the  Canadian  Model  having  the  desired  resolution  and 
contrast.  The  Type  1 mask  appeared  to  produce  the  best  results.  Some  of 
these  transparencies  were  used  to  make  spatial  filters  in  the  usual  manner. 
Their  auto  and  cross -correlation  performance  proved  to  be  markedly  better 
and  more  uniform  than  that  obtained  using  conventional  transparencies.  It 
was  possible  to  obtain  useful  correlations  in  many  areas  where  such  had  not 
been  obtained  in  conventional  copies  of  the  same  scenes. 

An  artifact  observed  when  using  these  silver  mask  copies  is  the 
presence  of  an  occasional  satellite  peak  adjacent  to  the  true  cross  correlation 
peak.  This  may  be  a result  of  a shadowing  effect  caused  by  slight 
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misregistration  of  the  silver  mask.  In  any  case,  this  satellite  peak  is 
always  relatively  weak  and  could  not  be  confused  with  the  true  correlation 
peak. 


Figures  5-3  through  5-5  illustrate  the  effect  of  silver  mask  copies. 
In  these  figures,  we  have  attempted  to  depict  as  accurately  as  possible  the 
appearance  of  transparencies  used  in  this  experiment.  The  prints  are  the 
same  polarity  as  the  actual  transparencies.  Figure  5-3  shows  the  original 
low  contrast,  high  resolution  diapositive.  The  areas  labeled  A,  B,  and  C 
are  regions  of  increasing  average  transmission.  A typical  high  contrast 
transparency  is  shown  in  Figure  5-4.  While  this  copy  has  greater  edge  con- 
trast and  good  resolution  in  many  areas  (e.  g.  Region  B),  other  regions  are 
overexposed  (A)  or  underexposed  (C)  and  have  lost  information.  A trans- 
parency made  with  the  silver  mask  technique  is  shown  in  Figure  5-5.  In 
this  case  there  is  good  resolution  and  contrast  throughout  the  frame  despite 
its  somewhat  unnatural  appearance.  In  particular,  Region  B still  has  good 
contrast  and  detail  while  Region  C shows  strong  edge  detail  which  was 
originally  of  low  contrast  in  Figure  5-3  and  completely  lost  in  Figure  5-4. 
Although  it  is  not  apparent  on  the  print,  the  contrast  of  detail  in  the  dark 
region  (A)  is  also  improved;  clear  areas  are  now  visible  between  trees. 

Our  results  indicate  that  high  contrast,  high  resolution  copies  of 
aerial  photographs  improve  correlation  performance  in  a coherent  optical 
system.  (They  would  probably  have  a similar  effect  if  used  in  an  electronic 
correlation  system  such  as  the  AS-11B) . Producing  such  copies  is  undesirable 
in  that  it  represents  an  additional  step  in  the  photogrammetric  process. 
However,  what  we  have  done  here  is  merely  an  extreme  case  of  local  dodging. 
Consequently,  the  production  of  such  copies  should  not  present  any  major 
operational  problems  since  continuous  strip  contact  printers  having  auto- 
matic dodging  capability  are  well  developed  and  commercially  available. 
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FIGURE  5-5.  SILVER  MASK  COPY 


SECTION  VI 


DATA  COLLECTION 


Several  steps  are  involved  in  collecting  parallax  data.  The 
scanner  and  correlation  peak  position  measuring  device  must  be  calibrated. 
The  input  transparency  must  be  properly  oriented  and  the  relation  between 
photo  and  scanner  coordinates  established.  The  actual  data  collection 
operation  must  be  planned  to  minimize  systematic  errors. 

« 

6.  1 SCANNER  LINEARIZATION  AND  CALIBRATION 

The  scanner  presently  in  the  COMAP  System  is  inherently  non- 
linear. That  is.  beam  position  in  the  input  gate  is  a non-linear  function  of 
the  voltage  applied  to  the  input  cf  the  galvanometer  drivers.  While  this 
non-linearity  could  be  corrected  during  photogrammetric  reduction  of  the 
data,  we  considered  it  more  desirable  to  linearize  the  scanner.  This  had 
two  advantages:  first,  it  simplified  subsequent  data  reduction,  and  second, 
it  allowed  operation  directly  in  photo  coordinates  which  ia  important  because 
it  greatly  simplifies  addressing  control  points. 

In  the  initial  calibration  and  during  all  subsequent  use  of  the 
scanner,  it  was  necessary  to  minimize  the  effect  of  galvanometer  hystresis. 
Addressing  the  same  point  in  the  input  from  opposite  directions  typically 
resulted  in  an  error  on  the  order  of  2 mm  (3  mrad). 

This  intolerable  hystresis  effect  is  avoided  by  resetting  the 
scanner  to  a specific  point  far  off  one  corner  of  the  field  before  addressing 
any  location  in  the  input.  This  procedure  is  simple  to  implement  with  the 
galvanometers  under  computer  control  and  was  always  used. 

Linear  scanning  was  achieved  in  a two-step  process.  First,  a 
photographic  plate  was  placed  in  the  input  plane  and  exposed  to  the  scan 
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produced  by  a series  of  equally  incremented  digital  values  sent  to  the  D/A 
converters  by  the  computer.  The  positions  of  the  spots  on  this  plate  were 
measured,  producing  a set  of  ordered  pairs  consisting  of  the  digital  addres- 
ses and  their  corresponding  displacements  in  the  input  plane.  A third  order 
polynomial  was  fitted  to  these  values.  The  computer  was  then  programmed 
so  that  any  point  in  the  input  plane  can  be  addressed  directly  by  its  photo- 
coordinates in  millimeters.  This  capability  of  addressing  directly  in 
photocoordinates  proved  to  be  a considerable  convenience  for  finding  reseaus 
and  control  points  in  the  input  scene. 


Repeatability  of  the  linearization  was  hampered  by  galvanometer 
zero  drift  and  gain  change.  These  effects  were  not  large  enough  during  a 
data  collection  run  to  cause  serious  problems.  Zero  drift  typically  caused 
a 0.  2 mm  offset  over  one  hour.  Gain  changes  manifested  themselves  over 
longer  times,  causing  typically  a 5 percent  scale  change  in  a 24  hour  period. 
Updating  of  the  third  order  polynomial  fit  by  altering  the  linear  coefficient 
to  accommodate  the  new  galvanometer  parameters  was  implemented  to 
account  for  small  changes.  Operating  the  scanning  system  in  a closed  loop 
or  self-calibrating  method  would  eliminate  changes  caused  by  zero  drift  and 
gain  changes,  thus  guaranteeing  both  linear  and  repeatable  scanning. 


INPUT  ALIGNMENT 


Correct  alignment  of  the  input  transparency  in  both  orientation 
and  position  maximizes  the  average  cross  correlation  signal-to-noise  ratio 
and  minimizes  the  parallax  range.  These  are  both  desirable  goals.  Con- 
sequently care  was  taken  to  ensure  good  alignment.  In  the  Canadian  Test 
Model  frames,  there  is  very  little  rotation  between  scenes  (the  yaw  angle  r| 
is  small)  and  we  decided  to  use  reseaus  for  alignment.  Where  there  is 
significant  rotation  between  frames,  the  input  must  be  oriented  on  the 
basis  of  selected  points  in  the  scene. 
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Alignment  is  achieved  by  using  the  holographic  property  of  the 
spatial  filter  to  allcw  simultaneous  viewing  of  the  frame  used  to  make  the 
filter  and  the  frame  presently  in  the  input.  To  do  this,  an  auxiliary  lens 
is  placed  just  after  the  filter  and  colinear  with  the  signal  beam  axis.  This 
lens  is  selected  so  that  it,  in  conjunction  with  the  Fourier  transform  lens, 
will  form  an  aerial  image  of  the  input  at  some  convenient  scale  and  location. 
This  image  can  be  viewed  directly  or  with  the  aid  of  a microscope.  The 
system  is  placed  in  the  filter  generation  mode  and  the  reference  beam  allowed 
to  illuminate  the  filter.  This  produces  a holographic  reconstruction  of  the 
input  used  to  make  the  filter.  To  an  observer  viewing  through  the  micro- 
scope, this  original  scene  appears  to  be  present  in  the  input  gate. 

Blocking  the  reference  beam  and  letting  the  signal  beam  to  pass 
will  allow  the  observer  to  see  the  scene  actually  in  the  input  gate.  Simul- 
taneous presence  of  the  reference  and  signal  beams  produces  superimposed 
images  which  greatly  simplify  alignment.  We  used  this  technique  to 
precisely  align  the  reseaus  of  the  frames  being  cross  correlated. 

The  scanner  coordinates  are  converted  into  photocoordinates  by 
locating  a particular  reseau  (commonly  the  master  reseau)  and  using  this 
information  to  determine  the  transformation  between  photo  and  scanner 

coordinates.  The  computer  program  then  allows  the  operator  to  directly 
input  photo  coordinates. 


6.  3 DATA  RUN  CALIBRATION  PLATES 

As  a check  of  system  consistency  and  performance,  a calibration 
plate  was  made  before  and  after  each  data.  This  consisted  of  placing  an  un- 
exposed photographic  plate  in  the  input  and  stepping  the  scanning  beam  along 
the  desired  scan  path  in  relatively  large  (2  mm)  intervals.  The  beam  was 
also  sent  to  a number  of  control  points.  The  resulting  plate  has  a series  of 
spots  which  can  be  used  to  verify  the  consistency  and  accuracy  of  the  scanner 
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in  tracking  properly  along  the  scan  and  in  properly  addressing  control 
points.  These  plates  were  made  relatively  easily  and  quickly  under  total 
computer  control. 

6.4  PARALLAX  DATA  COLLECTION 

Parallax  data  is  collected  by  scanning  the  beam  through  known 
locations  on  the  input  plane  while  monitoring  the  position  of  the  cross 
correlation  peak  in  the  output  plane.  Parallax  values  are  collected  for  con- 
trol points  where  ground  elevation  is  known  and  along  the  scan  line  for  which 
a profile  is  to  be  generated.  Typically,  two  hundred  0.  5 mm  steps  con- 
stitute a scan.  Parallax  at  from  ten  to  twenty  control  points  is  measured 
with  each  scan. 

A vidicon  camera  located  in  theoutput  plane  displays  the  cor- 
relation plane  on  a television  monitor.  Also  shown  on  the  television  monitor 
is  a pair  of  fixed  electronic  crosshairs.  The  position  of  the  correlation  is 
determined  by  displacing  the  vidicon  camera  until  the  correlation  peak  ap- 
pears directly  under  the  electronic  crosshairs.  Two  linear  precision 
potentiometers  attached  to  the  translation  stages  that  displace  the  vidicon  are 
used  to  measure  displacement.  Two  digital  voltmeters  operating  in  a 
ratiometric  mode  display  the  voltage  ratio  across  the  potentiometers. 

The  displacement  measuring  system  has  a 1.  5^jm  precision  and  is  linear  to 
at  least  0.  15  percent  over  the  typ.cal  displacement  range.  The  lack  of 
geometric  fidelity  of  the  vidicon,  thermal  drift  of  the  galvanometer  drivers, 
the  drift  of  the  electronic  crosshairs,  and  the  inability  to  precisely  locate  the 
position  of  the  correlation  peak  presently  affect  the  accuracy  obtained  for 
the  correlation  position  measurement. 

To  monitor  galvanometer  drift,  the  scanning  beam  is  periodically 
sent  to  a particular  reseau  which  is  projected  onto  a screen  by  a fixed 
microscope.  The  reseau  is  chosen  so  that  the  microscope  can  be  left  in 
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position  during  a complete  data  run  without  blocking  the  scanning  beam. 

A typical  projected  view  of  a reseau  is  shown  in  Figure  6-1.  In  this  case, 
the  galvanometer  has  drifted  so  that  the  scanning  beam  is  approximately 
0.5  mm  low.  This  is  a negative  transparency  and  the  black  cross  just  below 
the  reseau  is  a control  point  marked  on  the  ground  with  white  paint. 

During  parallax  data  collection,  the  operator  records  the  location 
of  the  scanning  beam  and  the  correlation  position  readings  from  the  digital 
voltmeters.  He  also  observes  the  monitor  and  makes  a subjective  estimate 
of  the  quality  of  the  correlation  peak  ranging  from  poor  to  excellent.  Typical 
video  signals  associated  with  correlation  peaks  of  various  subjective 
qualities  is  shown  in  Figure  6-2.  The  horizontal  scale  is  660pm/division 
and  a correlation  peak  is  less  than  100pm  wide  at  its  half  power  points.  The 
maximum  of  the  correlation  can  readily  be  determined  to  within  ±20pm. 

This  type  of  oscilloscope  display  was  not  used  for  data  collection;  only  the 
monitor-crosshair  display  was  used. 

6.  5 BEAM  DITHERING 

We  found  that,  in  regions  where  the  correlation  signal-to-noise 
ratio  was  low,  significant  improvement  in  signal-to-noise  could  be  obtained 
by  dithering  the  beam.  That  is,  the  beam  was  rapidly  moved  to  a series  of 
locations  around  the  nominal  beam  position.  The  locus  of  these  points  was 
at  a radius  of  one  half  beam  diameter  (^->0.  5 mm)  from  the  nominal  position. 
This  simulates,  to  some  extent,  the  use  of  a larger  beam.  The  effect  of 
dithering  is  illustrated  in  Figure  6-3. 

This  technique  proved  to  be  extremely  useful  while  collecting 

parallax  data.  The  computer  was  programmed  so  that  the  operator  could 

request  beam  dithering  at  any  time  as  the  computer  stepped  the  beam  across 

the  scan  line.  In  a number  of  instances,  adequate  correlation  peaks  were 

produced  where  a very  poor  peak  or  none  at  all  could  be  observed  with  a 
stationary  beam. 
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FIGURE  6-1.  RESEAU  AND  CONTROL  POINT  ILLUMINATED 
BY  SCANNING  BEAM 
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(a)  FXCELLENT 


(c)  POOR 


FIGURE  6-2.  VIDEO  SIGNALS  CORRESPONDING  TO 
CORRELATION  PEAKS 
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(a)  CORRELATION  PROFILE  WITHOUT  DITHERING 


(b)  CORRELATION  PROFILE  WITH  DITHERING 


FIGURE  6-3.  EFFECT  OF  SCANNING  BEAM  DITHERING 
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Beam  dithering  improves  correlation  performance  by  means  of 
two  effects.  First,  the  beam  sweeps  out  a larger  area,  thus  increasing  the 
probability  that  some  details  capable  of  yielding  a good  correlation  will  be 
illuminated.  Second,  the  process  tends  to  incoherently  sum  the  desired 
correlation  peak  over  all  these  beam  positions  while  averaging  the  noise. 
That  is,  for  each  beam  position,  noise  peaks  occur  at  slightly  different 
locations  in  the  output  while  the  desired  correlation  peak  always  tends  to 
appear  in  the  same  place. 

This  technique  has  produced  such  significant  results  that  it  should 
be  considered  as  an  adjunct  or  possible  replacement  for  beam  size  control 
in  a COMAP  system.  Besides  its  apparent  effectiveness,  it  has  the  ad- 
vantage of  requiring  no  additional  components  and  practically  instantaneous 
response.  Beam  size  controls  which  involve  moving  lenses  or  an  iris  will 
be  slower. 


6.  6 


DATA  COLLECTION  PROGRAM 


The  operation  of  the  data  collection  program  is  indicated 
schematically  in  the  flowchart  of  Figure  6-4.  The  program  was  written 
in  a modified  version  of  "Focal,  " a ligh  level  language  commonly  used  on 
Digital  Equipment  Corporation's  PDP8  series  of  minicomputers. 


DISPLAY  PRESENT 
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FIGURE  6-4.  DATA  COLLECTION  PROGRAM  FLOWCHART 
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SECTION  VII 


DATA  REDUCTION  AND  EVALUATION 

Photogrammetric  data  reduction  and  evaluation  were  performed 
by  DBA,  Inc.  , Melbourne,  Florida.  Data  collection  runs  were  made  from 
time  to  time  during  this  program.  Each  complete  set  of  data  was  promptly 
reduced  and  plotted  along  with  the  corresponding  parallax  profiles  derived 
from  AS- I IB  data.  Results  were  discussed  and  necessary  modifications  in 
equipment  or  procedures  determined.  The  consistency  and  accuracy  of  the 
data  improved  with  each  data  run  until  the  last  several  sets  of  parallax  data 
showed  excellent  agreement  with  AS-llB  parallax  profiles. 

7.  1 DATA  REDUCTION 

Data  reduction  procedures  were  developed  and  modified  as 
necessary  as  the  effort  progressed.  The  methods  employed  were  not 

strictly  rigorous,  bat  seemed  to  be  the  best  approach  in  view  of  the  current 
hardware  restrictions. 

A mathematical  model  of  the  AS-llB  system  was  developed  and 
used  to  compute  AS-llB  parallaxes  and  ground  point  coordinates.  The 
AS-llB  stereo-model  parameters  from  the  Canadian  shutdown  tape, 
supplied  by  RADC.  were  entered  in  DBA's  analytical  model  and  derived 
ground  point  coordinates  were  checked  against  the  supplied  control  values. 
Twenty  points  which  were  read  as  AS-llB  setup  points  had  one  sigma  value 
with  respect  to  the  known  control  of  . 1 1 meters  in  x,  . 15  meters  in  y,  and 
. 32  meters  in  z (approximately  1 2gx). 

The  parallax  values  for  points  within  the  model  were  computed 
in  the  following  manner:  (1)  using  the  analytical  AS-llB  model  the  correct 
object  space  coordinates,  and  the  photo  coordinates  for  all  control  point, 
and  profiles  were  computed:  (2)  the  cp  and  u>  angle,  were  set  equal  to 
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zero;  (3)  an  arbitrary  point  wa.  selected  (control  point  (30);  and  the  "y" 
coordinate  of  the  exposure  station  for  photograph  two  was  translated  until 
this  point  had  zero  "y"  parallax;  (4)  the  photo  coordinate,  for  all  point,  were 
then  computed  using  this  model  orientation  with  the  elevation  of  all  points 
being  considered  as  that  of  (control  point  30)  the  arbitrary  reference  point; 
(5)  the  difference  between  the  two  set.  of  photo  coordinate,  was  defined 
equal  to  the  parallax  relative  to  the  chosen  reference. 

The  image  correlator  data  wa.  reduced  in  the  following  manner: 

(1)  the  output  parallaxes  were  scaled  by  appropriate  constant,  to  transform 
them  to  an  absolute  system,  .48638  for  and  .62^73  for  P ;*  (2)  the 
output  x,  y coordinate,  were  transformed  into  the  AS- 11  model  coordinate 
system,  using  a linear  conformal  transformation;  (3)  the  parallaxes,  as 
read  on  the  control  point,  within  the  image  correlator  model  area  (ap- 
proximately 20  points),  were  adjusted  into  the  parallaxes  as  derived  on  the 
corresponding  point,  from  the  AS-11  analytical  model;  (4)  the  x and 

yp  adjustment,  were  computed  separately  using  a least  square.Padju.tment 
of  the  following  equations; 


p*'  1 Px  + + atx  + *ay  »nd  py'  = py  + b0+  b,x  + b,y, 

where  wa.  the  AS-11  derived  parallax  during  the  least  square. 

solution  for  a„,  a,,  and  a,  and  became  the  derived  parallax  when  the 

equation  wa.  evaluated.  Py'  wa.  found  in  the  .am.  manner;  (5)  this 

adjustment  effectively  adju.ted  the  plane,  of  the  two  parallaxe.  together- 

(6)  the  results  were  plotted  on  a c.lcomp  plotter,  the  vertical  axis  being 

either  x or  y parallax  while  the  horizontal  axi.  wa.  the  y positional 
coordinate. 


See  Appendix  A for  an  explanation  of  why  the  parallax  scales  differ  between 


FIGURE  7-1.  CANADIAN  TEST  MODEL  PLATE  #1 
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positions  of  the  correlation  peak  as  being  identical.  There  was  some 
rotation  between  the  scenes  being  cross  correlated  so  that  reading  the  same 
correlation  peak  position  over  several  sample  points  produces  a parallax 
curve  having  a constant  slope. 

This  is  primarily  a psychological  phenomena  in  that  an  observer 
watching  the  TV  monitor  tended  not  to  notice  small  changes  in  the  cor- 
relation peak  position  when  the  peak  was  already  almost  centered  on  the 
electronic  crosshairs.  Because  of  this,  we  adopted  the  procedure  of  in- 
tentionally displacing  the  vidicon  camera  at  each  sample  point  so  that  the 
correlation  peak  was  well  clear  of  the  crosshairs.  The  correlation  was 
then  brought  back  to  the  crosshair  intersection  and  vidicon  camera  position 
recorded.  The  new  procedure  effectively  eliminated  this  "same  as  before" 
problem  in  subsequent  data  collection  operations. 

Another  interesting  feature  of  Figure  7-4  is  the  fit  between 
COMAP  data  is  better  for  larger  values  of  scan  (y)  position  than  at  lower 
values.  The  great  majority  of  control  points  used  in  this  case  were  located 
between  y 40  mm  and  y 100  mm.  Because  of  this  weighting,  the  ad- 
justment of  COMAP  data  into  the  AS-11B  system  forced  a better  fit  at  this 
end  of  the  scan.  Care  was  taken  in  later  efforts  to  provide  a more  uniform 
distribution  of  control  points. 

Despite  the  problems  involved,  the  data  in  Figures  7-3  and  7-4 
show  good  agreement  between  GOMAP  and  AS-11B  parallaxes.  The  difference 
in  regions  of  better  fit  are  quite  small  and  even  in  regions  of  worst  fit,  the 
average  difference  is  50pm  or  less.  Some  of  the  difference  between  the 
curves  is  a result  of  the  noncoincidence  of  the  COMAP  and  AS-11B  scan 
paths. 

Figure  7- 5a  shows  data  collected  using  improved  resolution  in 
the  vidicon  camera  position  measurement.  The  COMAP  data  has  good 
detail  and  follows  essentially  all  of  the  terrain's  undulations.  However, 
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there  is  an  obviously  increasing  difference  between  the  curves  with  larger 
values  of  scan  pot.  tion  (y).  This  implies  that  there  was  some  residual  ro- 
tation between  the  scenes  being  correlated.  A computer  program  was  used 
to  determine  this  rotation  and  to  recalculate  the  COMAP  data  with  any 
rotational  and  translational  biases  removed.  The  recalculated  parallaxes 
are  plotted  in  Figure  7-5b  which  shows  an  excellent  fit  between  the  COMAP 
and  AS-llB  curves.  A portion  of  the  data  at  both  ends  of  the  scan  was  not 
recalculated  and  is  omitted.  Note  that  the  scale  of  Figure  7-5b  is  20(^m/ 
division  while  that  of  7-3a  is  300|i/division.  Differences  between  the  curves 
are,  therefore,  emphasized  in  Figure  7-5b  as  against  Figure  7-5a. 

Figures  7-6a  and  7-6b  show  a similar  situation.  While  the  fit 
between  COMAP  and  AS-llB  data  is  good  in  7-6a,  it  is  considerably  im- 
proved when  translational  and  rotational  biases  are  removed  as  in 
Figure  7-6b, 

7.  3 EVALUATION  OF  DATA 

The  data  ultimately  produced  by  the  COMAP  system  shows 
remarkably  good  agreement  with  that  produced  by  the  A.S-11B.  The  fit 
between  the  curves  shown  in  Figures  7-3  through  7-6  is  very  good, 
especially  considering  that  the  scan  paths  between  COMAP  and  AS-llB 
were  between  50pim  and  200]jm  apart  in  all  cases.  There  is  also 
uncertainty  of  at  least  lO^m  in  the  AS-llB  data  itself. 

The  last  two  data  sets  (Figures  7-5  and  7-6)  were  numerically 
analyzed  to  find  the  r,  m.  s.  difference  between  COMAP  and  AS-11  data. 

The  results  are  tabulated  in  Table  I,  which  shows  that  r.m.  s.  differences 
of  approximately  40yim  to  60|om  resulted  when  rotational  and  translational 
biases  were  removed.  In  both  these  cases,  relatively  small  intervals  near 
the  ends  of  the  scans  contribute  a great  deal  to  the  rms  difference.  This  is 
due  to  a few  extreme  points  and  steep  slopes.  A significant  source  of 
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error  in  regions  of  steep  slope  is  the  inaccuracy  in  the  galvanometer 
scanner.  The  r.  m.  s.  error  achieved  when  some  suspect  data  is  edited  out 
is  also  listed  in  Table  I.  Ignoring  a small  region  (14  mm)  in  Figure  7-6 
near  a precipitous  cliff  reduces  the  r.m.s.  difference  between  COMAP  and 
AS-11B  data  to  24pm  in  x parallax.  The  position  of  the  cliff  varies  rapidly 
with  x and  even  a small  difference  between  COMAP  and  AS-11B  scan  paths 
can  introduce  large  differences  in  parallax. 

We  feel  the  COMAP  system  has  yielded  results  of  remarkable 
accuracy,  considering  the  hardware  limitations  of  the  present  system. 
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TABLE  I 


RMS  VALUES  (gm)  FOR  DATA  SETS  3 AND  4 


Scan  Interval 
(mm) 

Set  #3 

Raw  Data 
Adi.  to  Control 

Translational 

Bias 

With  Bias 
Removed 

With  Rotational 
Bias  Removed 

I — J- 

P 

X 

P 

y 

Bias  X Bias  Y 

P 

X 

P 

y 

P 

X 

P 

y 

Unedited 
-9.  351-*96.  708 

78.4 

81.  1 

47.  9 

-47.  2 

62.  1 

65.  9 

56.  5 

56.7 

Edited 

10.  030-+74.  635 

78.  7 

94.  8 

68.  3 

-77.  3 

39.  0 

54.  8 

30.  1 

20.9 

Set  #4 


Unedited 
-9.  384-»97.  002 

63.2 

40.  6 

13.0 

- 3.5 

61.9 

40.  4 

40.  8 

37.  5 

Edited 

-9.  384-*83.  569 

52.  5 

38.  9 

24.  2 

. 4 

46.  6 

38.  9 

24.  2 

37.  2 
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SECTION  VIII 


SYSTEM  PERFORMANCE 


There  are  a number  of  factors  which  will  determine  the 
feasibility  of  an  automatic  atereocompiUtion  system.  These  include  speed, 
accuracy,  cost,  data  format,  complexity,  capability  and  convenience.  We 
feel  a COMAP-type  system  has  the  potential  for  cost  effective  operation 
and  may  offer  significant  advantages  including  the  ability  to  be  configured 
into  a compact  and  rugged  field  unit,  especially  where  smaller  format  (5" 
and  70  mm)  imagery  is  involved.  The  following  discussion  covers  factors 
relevant  to  potential  system  performance  and  includes  an  estimate  of  system 
performance.  Advantages  and  problem  areas  are  pointed  out. 


8.  1 ACCURACY 

The  accuracy  of  any  automatic  stereocompilation  system  em- 
ploying cross-correlation  is  ultimately  limited  by  the  resolution  of  the 
imagery.  The  sharpness  and  the  accuracy  with  which  the  center  of  a 
correlation  peak  can  be  located  is  determined  by  the  maximum  useful 
resolution  of  the  imagery.  A pair  of  low  resolution  images  will  produce 
broad,  poorly  defined  correlations,  while  the  opposite  is  true  for  high 
resolution  imagery.  In  systems  employing  image  sampling  techniques  (such 
as  a digital  correlator),  effective  resolution  is  limited  by  the  resolution  and 
accuracy  of  the  sampling  system.  (It  should  be  noted  that  sampling  scan 
jitter  will  cause  an  effective  loss  of  resolution  as  far  as  cross  correlation 
is  concerned,  since  sample  values  will  not  appear  in  their  proper  location). 

Parallax  measurement  accuracy  will  be  limited  by  the  effective 
overall  resolution  of  the  system  performing  the  cross  correlation.  A 
coherent  optical  processor  (COMAP)  can  readily  be  designed  and  built  with 
an  overall  resolution  exceeding  that  usually  achieved  in  aerial  photography. 
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The  present  COMAP  optic,  are  de.igned  tor  200  Ipmm  imagery  and  a 
different  system  configuration  may  allow  even  greater  resolution  with 
simpler  and  less  expensive  lenses.  Hence  an  optical  correlator  should  be 
able  to  measure  parallax  to  the  accuracy  limit,  imposed  by  the  imagery. 

On  this  basis,  the  accuracy  of  an  optical  correlator  should  equal  or  exceed 
that  of  an  electronic  (digital)  correlator. 

in  order  to  achieve  this  parallax  accuracy  in  practice,  scanning 
beam  pointing  and  correlation  peak  location  must  be  done  with  suitable 
precision.  The  experimental  result,  presented  in  Section  7 demonstrate 
that  the  present  COMAP  hardware  is  capable  of  yielding  rather  accurate 
parallax  data.  A considerable  increase  in  scanner  and  correlation  peak 
location  accuracy  can  be  accomplished  by  relatively  straightforward  hard- 
ware  improvements.  Thus,  it  is  reasonable  to  conclude  that  a COMAP-type 
system  can  measure  parallax  to  the  limit  of  the  accuracy  imposed  by  the 

imagery  itself. 


8.2  SPEED 

In  considering  system  speed,  it  is  necessary  to  differentiate 
between  instantaneous  and  average  speed.  While  the  first  may  be  im- 
pressive, it  is  the  latter  that  is  most  important.  Interruption,  in  system 
operation  can  produce  an  average  throughput  rate  considerably  lower  than 

the  maximum  instantaneous  rate. 

For  all  practical  purposes,  the  only  moving  part,  in  the  COMAP 
system  are  the  scanning  beam  galvanometers.  It  is  conservative  to  say  that 
the  scanning  beam  can  be  brought  to  any  given  point  within  10  msec. 

Assuming  that  the  parallax  data  is  required  on  a . 333  mm  x 0.  333  mm  grid 

(i.e.  10  point./mma).  the  scanner  is  able  to  cover  100  mm» /sec.  Stnce 

practical  galvanometer  scanner,  can  run  several  time,  this  speed,  scanmng 
beam  positioning  time  is  adequate  for  very  fast  operation  (over  100  mm’/sec). 
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Location  of  the  correlation  peak  represents  a more  significant 
limit  on  system  operation.  If  a conventional  TV  image  tube  is  employed 
a sampling  rate  of  approximately  30  frames  per  second  must  be  used. 
Assuming  again  that  ten  samples  per  mma  are  required,  the  system  coverage 
would  be  3 mm3/sec;  a good,  but  not  outstanding  rate.  This  example 
makes  it  clear  that  correlation  peak  position  measurement  is  one  of  the 
major  factors  limiting  overall  system  speed. 


Fortunately  we  are  not  limited  to  conventional  TV  image  tubes  for 
locating  correlation  peaks;  there  are,  in  fact,  several  alternative  devices. 
These  include  solid  state  sensors  (CCD's,  CID's)  and  the  image  dissector. 
Solid  state  detectors  offer  a number  of  advantages;  they  are  compact, 
rugged  and  metrically  accurate.  Moreover,  they  are  not  subject  to  the 
image  retention  (lag)  characteristic  of  a vidicon  and  they  may  be  scanned  at 
a higher  rate  than  30  frames /sec. 


Rapid  and  significant  advances  have  been  made  in  one  and  two 
dimensional  solid  state  arrays.  They  are  presently  available  with  a suf- 
ficient number  of  resolution  elements  to  serve  as  a correlation  peak  position 
measuring  device.  It  seems  probable  that  such  a device  could  be  made  to 
operate  at  one  hundred  frames  or  more  per  second  using  present  technology. 
This  would  imply  an  area  coverage  of  at  least  10  mm3/ sec  in  the  COMAP 
system.  A somewhat  more  sophisticated  approach  could  yield  sample  rates 
several  times  as  great  as  this. 

The  image  dissector  is  interesting  in  that  it  offers  the  possibility 
of  directly  tracking  the  correlation  peak  as  the  scanning  beam  moves  about 
the  input  gate.  The  dissector  could  operate  in  a star  tracking  mode  or  pro- 
vide a small  moving  raster  scan.  This  would  limit  the  number  of  resolution 
elements  sampled  and  could  allow  very  rapid  location  of  the  correlation 
peak.  Moreover,  the  dissector  scan  could  be  easily  expanded  to  recapture 
the  correlation  peak  when  the  scanning  beam  passes  through  regions  of  the 
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input  which  do  not  correlate.  This  would  help  to  maintain  a high  average 
throughput  rate.  Control  and  calibration  of  an  image  dissector  could  be 
somewhat  complicated  but  its  potential  flexibility  recommends  it  for  further 
consideration.  The  comparitively  low  sensitivity  of  an  image  detector  might 
require  undesirably  high  illumination  levels  at  the  input  gate. 

A significant  feature  of  a COMAP  system  is  its  ability  to  auto- 
matically find  the  desired  correlation  after  it  has  been  lost  for  some  reason. 
This  can  happen  if  the  scanning  beam  illuminates  a lake,  snowfield,  or  other 
region  which  contains  no  useful  detail.  When  such  a situation  arises,  the 
scanning  beam  can  simply  be  moved  until  a clearly  identifiable  correlation 
peak  occurs  in  the  output.  Fill-in  between  regions  of  good  correlation  can  be 
rapidly  executed  by  extrapolating  the  probable  path  of  the  correlation  peak 
and  restricting  peak  detection  to  this  area.  This  can  be  accomplished  with 
any  of  the  sensors  discussed  above  by  suitable  video  signal  processing. 
Similarly  abrupt  changes  in  parallax  can  be  handled  readily  since  there  is 
no  need  for  maintaining  an  image-to- image  lock  in  the  COMAP  system. 

This  self-finding  ability  should  allow  a COMAP  system  to  main- 
tain a high  average  as  well  as  instantaneous  throughput.  Human  intervention 
should  not  be  required  to  help  the  system  when  regions  of  poor  correlation 
or  abrupt  parallax  shifts  are  encountered. 

In  summary,  it  should  be  relatively  straightforward  to  design  and 
build  a COMAP-type  system  having  an  instantaneous  throughput  rate  of 
about  10  mm2/sec.  A more  sophisticated  approach  to  the  correlation  peak 
detection  problem  could  increase  this  throughput  by  an  order  of  magnitude 
to  100  mm3 /sec.  The  average  throughput  rate  of  the  system  should  be  close 
to  the  instantaneous  rate  since  the  system  can  be  made  self-finding  and  human 
intervention  can  be  minimized  or  eliminated. 

Another  important  factor  affecting  the  overall  system  speed  is 
discussed  under  Data  Format  (.Section  8.  3). 
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8.  3 DATA  FORMAT 

A COMAP  system  allows  extremely  flexible  data  formatting  in 
that  the  scanning  beam  may  be  directed  to  any  point  in  the  input.  Scanning 
can  be  programmed  to  obtain  data  at  arbitrary  points  in  either  photo  or 
model  coordinates.  It  is  not  necessary  to  collect  data  at  one  array  of  x,  y 
coordinates  and  then  convert  this,  by  means  of  interpolation,  to  another 
array  of  coordinates  (e.  g.  , from  epipolar  lines  to  a regular  array  in  model 
coordinates).  This  can  substantially  reduce  subsequent  data  processing  and 
effectively  increase  the  throughput  rate  of  the  overall  system. 


8.4  SIZE  AND  MOBILITY 

The  size  of  a COMAP  system  depends  upon  the  frame  size  of 
the  imagery.  Folding  the  optics  by  means  of  mirrors  can  produce  a very 
compact  optical  processor  occupying  say  fifty  cubic  feet  or  less.  The 
electronics  involved  could  be  fit  into  one  or  two  standard  racks.  It  is 
usually  assumed  that  an  automatic  stereo  compilation  system  such  as  this 
would  be  operated  in  a headquarters  or  laboratory  environment.  However, 
a COMAP  system  could  be  ruggedized  and  compacted  to  a tactical  field 
support  unit  if  desired.  Where  smaller  frame  size,  say  70  mm  or  5 inch 
imagery  is  involved,  a very  compact  unit  could  be  designed. 

One  problem  with  a non-laboratory  environment  is  associated 
with  spatial  filters.  This  normally  requires  great  system  stability.  How- 
ever, by  means  of  either  short  exposures  using  a pulsed  laser  or  dynamic 
fringe  (phase)  control,  stability  requirements  can  be  greatly  relaxed  and 
should  represent  no  major  difficulty. 


8.5  OPERATIONAL  CONVENIENCE 

Most  of  the  operations  involved  in  a COMAP  system  can  be  made 
automatic.  This  includes,  in  particular,  the  filter  making  operation; 
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exposure  and  K ratio  can  be  placed  entirely  under  computer  control. 

When  measuring  parallax,  the  operator  may  have  t.o  establish  initially  the 
interior  orientation  of  an  input  and  to  specify  control  points.  Data  col- 
lection can  then  proceed  automatically  and  operator  intervention  should  not 
be  required.  The  system  can  be  designed  to  operate  on  roll  film  and  there 
will  be  no  need  to  separate  and  insert  individual  frames. 
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8.  6 PANORAMIC  IMAGERY 

The  COMAP  system  has  only  been  demonstrated  on  vertical  frame 
photography.  Of  course,  panoramic  and  convergent  panoramic  imagery  is 
of  great  interest.  In  order  to  handle  panoramic  photographs,  it  may  be 
necessary  to  introduce  anamorphic  optics  in  the  COMAP  system.  However, 
this  has  not  been  established  as  a firm  requirement,  and  it  is  possible  that 
such  a complication  may  not  be  needed  in  cases  of  practical  interest.  This 
problem  must  yet  be  evaluated  empirically. 

8.  7 OMNIDIRECTIONAL  AIR  BASE,  SCALE  AND  ORIENTATION 

Air  base  direction  has  no  practical  effect  on  COMAP  system 
performance.  The  input  transparency  remains  centered  in  the  optical  system 
regardless  of  the  air  base  direction.  The  input  must  be  oriented  properly, 
but  this  is  easily  accomplished  and  could  even  be  done  automatically  by 
measuring  the  intensity  of  the  correlation  peak  produced  by  several  local 
areas  as  the  input  is  rotated.  Depending  upon  the  actual  construction  of  the 
input  gate  assembly,  any  relative  orientation  between  frames  can  be 
handled. 

The  system  can  also  be  arranged  to  handle  limited  variations  in 
scale  (say  ±10%).  This  allows  stereocompilation  using  side  lapping  as  well 
as  front  lapping  imagery  and  tolerates  reasonable  variations  in  altitude. 
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APPENDIX  A 


PARALLAX  SCALE  IN  A COHERENT  OPTICAL  PROCESSOR 


In  a coherent  optical  processor  employing  a matched  spatial 
filter,  the  location  of  a correlation  peak  is  directly  related  to  the  position  of 
the  input  signal.  Tha*  is,  if  a signal  f(x)  is  located  at  position  Xq  when  a 
filter  is  made  and  at  during  the  correlation  operation,  the  resulting  cor- 
relation peak  will  be  located  at  a position  u determined  by  xx  and  Xq.  A 
simple  analysis  based  on  the  correlation  analogy  implies  u = x,  - Xq  . How- 
ever, the  following  analysis  which  considers  the  grating-like  character  of 
the  hologram,  indicates  a more  complex  relation  between  u and  xx,  Xq, 


1*  C«  | 


U = U [x  - So] 


where  a t b. 


Consider  the  situation  in  Figure  A-l  where  a hologram  is  re- 
corded in  plane  H.  The  correlations  are  formed  by  lens  Lx  in  the  plane 
Q and  x is  a general  point  in  the  input  plane  P.  During  the  correlation 


process,  the  reference  source  S_  is  blocked. 

R 


During  the  hologram  recording  process,  let  there  be  a.  small, 

well-defined  pattern  f(x)  centered  at  the  point  x . For  the  time  being,  we 

8 

assume  y - 0 and  that  this  is  a two  dimensional  (x,  z)  problem.  The  dif- 


fraction pattern  caused  by  the  signal  at  x interferes  with  the  reference 

s 


beam  so  as  to  create  a grating  whose  average  spatial  frequency  is  determined 
by  the  well-known  relation 


X/d  = sin  0 + sin  0 . 

R S 


Now  during  the  correlation  operation,  the  pattern  may  be  centered  at  any 


arbitrary  x in  which  case  the  ray  corresponding  to  the  center  of  the  pat- 
tern strikes  the  hologram  at  an  angle 
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a.  FILTER  CONSTRUCTION 


88500-20 


b.  CORRELATION 

FIGURE  A-I.  PARALLAX  SCALE  DEFINITION 


arctan  (x/F). 


e.  - 

i 

Without  any  loss  of  generality,  we  may  set  all  focal  lengths  equal  to  unity 
so  that  x and  u become  normalized  coordinates.  This  ray  will  be  dif- 
fracted at  an  angle  0d  where 


sin  0 ■»  sin  0d  - \/d  sin  0R  + 0g- 

The  hologram  will  reconstruct  the  collimated  reference  beam  at  the  angle 

0 . This  reconstructed  beam  focuses  to  a correlation  peak  located  at 
d 

u = tan  (0d  - 0R). 


We  are  interested  in  determinin g u as  a function  of  and  x, 

the  original  and  final  locations  of  the  pattern  in  question.  In  particular,  we 
wish  to  determine  the  scale  of  the  motion  of  the  correlation  peak  relative  to 


that  of  the  input  pattern.  We  need 

M 


Now 


du 

dx 


u tan  (0d  - 0R) 


and 


0 - arc.sin  (sin  0 + sin  0 - sin  0.) 

cl  is.  5 l 

0^  - arctan  (x) 
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= [1  - (sin  Gr  + sin  0g  - sin  G^3]'2 

l 


ML  = (i  + x3)-1 


bx 


If  we  assume  the  pattern  moves  only  a small  amount  then  we  can 


evaluate  these  functions  at  x = x , 8.  = 0 , 0 . = 0^  so  that 

s i s d R 


bu 


59 


= sec3  (0)  = 1 


50d 

b0i 


[1  - Sin3  0R]~ 2 = sec  SR 


and 


= [i  + x>3 


81-1 


M , P - 111  jR 

* dx  1 + x* 


for  small  motions. 


There  is  no  grating  effect  in  the  orthogonal  dimension  so  that 


M -P  =1 

y dy 


Of  course,  the  results  are  normalized  to  the  focal  lengths  of  the  transform 
and  imaging  lenses. 


Actual  measurements  on  the  COMAP  system  using  linear 
potentiometers  gave, 


M = 
x 


Y2~Js4  <arbitrary  unit*) 
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y 15.767 


■ 


= 0.7835 


= arccos  (38.  42) 


A relatively  crude  direct  measurement  of  0 indicates  that 

£v 

Q = 38.  5°  (±0.25°). 
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CONCLUSION 

Parallax  scale  is  a function  of  input  position  and  reference  beam 
angle.  For  a limited  field  and  small  parallax  displacement,  the  parallax 


scales  are 


M 2s  sec  (0  ) 

X K 


M = 1. 
y 


When  large  fields  and/or  parallaxes  are  involved,  a more  sophisticated  (and 
non-linear)  relation  must  be  used.  In  particular,  the  (1  + xa)"A  factor 


cannot  be  ignored. 


APPENDIX  B 


HARTMAN  MASK  TEST 


Insertion  of  a Hartman  mask  in  the  COMAP  system  signal  beam 
revealed  the  presence  of  significant  spherical  aberration.  The  severity  of 
this  aberration  makes  it  desirable  to  define  the  plane  of  non-paraxial  focus 
as  the  filter  plane.  If  the  plane  of  paraxial  focus  is  used,  the  intersection 
of  the  scanning  beam  with  the  filter  plane  is  not  constant,  but  depends  upon 
the  position  of  the  scanning  beam  in  the  input  plane.  This  makes  final 
alignment  of  the  scanner  very  difficult.  If  the  non-paraxial  plane  of  focus  is 
chosen  as  the  filter  plane,  the  scanning  beam  remains  stationary  in  the 
filter  plane  for  all  practical  purposes. 

We  have  not  determined  the  exact  cause  of  this  spherical  aber- 
ration. It  could  be  introduced  by  the  collimator  or  the  large  Fourier  trans- 
form lens  or  both.  While  the  aberration  must  be  considered  for  alignment 
purposes,  it  has  no  significant  effect  on  the  basic  correlation  operation. 

Figures  B-l  and  B-2  illustrate  the  effect  of  the  spherical 
aberration  in  the  signal  beam.  Figures  B-la  and  B-lb  show  the  light 
intensity  in  the  plane  of  paraxial  focus.  A short  exposure  (B-la)  reveals 
the  usual  Airy  disc  with  some  diagonal  flare  evident.  A longer  exposure 
(B-lb)  shows  the  extent  of  this  flare.  The  shape  of  the  flare  is  caused  by 
the  4"  x 5"  rectangular  opening  in  the  input  gate. 

Placing  a mask  in  the  input  with  two  small  (1  mm)  off-axis, 
diametrically  opposed  holes  produces  the  pattern  of  Figure  B-lc  in  the 
paraxial  focus  plane.  It  is  clear  the  non-paraxial  rays  do  not  intersect  the 
center  of  the  paraxial  plane. 

• I 

Figures  B-2a,  b and  c show  the  corresponding  situation  in  the 

plane  of  non-paraxial  focus.  This  plane  is  750|^m  from  the  paraxial  focus. 
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(a)  FULL  APERTURE  FOCUS  (b)  FULL  APERTURE  FOCUS  (OVEREXPOSED) 

(PLANE  OF  PARAXIAL  FOCUS)  (PLANE  OF  PARAXIAL  FOCUS) 


(c)  FOCUS  OF  HARTMANN  MASK 
(PLANE  OF  PARAXIAL  FOCUS) 

l 

FIGURE  B-l.  SIGNAL  BEAM  HARTMANN  TEST, 

PLANE  OF  PARAXIAL  FOCUS 


(a)  FULL  APERTURE  FOCUS 
(PLANE  OF  NONPARAXIAL  FOCUS) 


(b)  FULL  APERTURE  FOCUS  (OVEREXPOSED) 
(PLANE  OF  NONPARAXIAL  FOCUS) 


I 


(c)  FOCUS  OF  HARTMANN  MASK 
(PLANE  OF  NONPARAXIAL  FOCUS) 


FIGURE  B-2.  SIGNAL  BEAM  HARTMANN  TEST, 
PLANE  OF  NON-PARAXIAL  FOCUS 
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Rome  Air  Development  Center 


RADC  is  the  principal  AFSC  organization  charged  with 
planning  and  executing  the  USAF  exploratory  and  advanced 
development  programs  for  information  sciences,  intelli- 
gence, command,  control  and  communications  technology , 
products  and  services  oriented  to  the  needs  of  the  USAF. 
Primary  RADC  mission  areas  are  communications , electro- 
magnetic guidance  and  control,  surveillance  of  ground 
and  aerospace  objects,  intelligence  data  collection  and 
handling , information  system  technology , and  electronic 
reliability , maintainability  and  compatibility . RADC 
has  mission  responsibility  as  assigned  by  AFSC  for  de- 
monstration and  acquisition  of  selected  subsystems  and 
systems  in  the  intelligence,  mapping,  charting , command, 
control  and  communications  areas. 


